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ABSTRACT 

This paper discusses the concept of the critical 
incidents technique, traces its early developaent in the training of 
airplane pilots during florid War II, sketches the reguireaents of the 
typical steps, notes the fev studies in coaaunication using this 
technique, provides an evaluation, and briefly describes a study 
concerning departoent chairaen. The critical incidents technique is a 
way of obtaining ainiatare cases which can then be inductively ^ 
categorized to find the behavioral diaensions of the general aia of 
organizational aia educational coaaunication. The purpose of applying 
the technique in a coaounication a.idit of departaent chair aen is to 
provide an ezaaple of its use in an educational setting, to study its 
strengths and weaknesses, and to deter aine its adaptability to 
education. (RB) 
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The Application of Critical Incident Procediires 

for an Initial Audit of Organizational Cocrnunicatlon 

R. S. Rutherford 

SUNY College, Geneseo, N.Y, 



This paper ir> to orient the reader to the concept of the crit.i 
incident technique, trace its early development, sketch the require 
ments of the typical steps, note the few studies in conmunication, 
provide an evaluation, and briefly describe study concerning 
department chairmen. The questions to be answered are: What is 
it? Why use it? Vliat are the cor.dHions required? Wliere is it 
strong and weak? '^^^o is an exarcpls of its use in a communication 
audit? 

Intr oduction the Co n cept oi the 
CritieaV Tno.:jor.T. "Vvr.r.icuf; 

An audit ;.-jiy p<■:rpe^ucve error l.y using constrjots which ir.?i-.:a 
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shitbolethst Tenus of hij^h abstraction may be little better. It 
has impressed the writer that Miny of the theoretical functions of 
adniinistration have elements of corsmunication in them — planning, 
organization, motivation, and control. It seemed that the touch- 
stone which enabled transfer of executives as interchangeable 
parts ^etveen Indus crial, military, and educational positions 
might be ccrxninication in its hur^n relations and conceptual aspects 
Baffled in attempts to apply the abstractions of classical and 
modern theories of adiiinistration, the writer turned to a direct 
initial analysis of organizational communication related to de- 
partment chairmen and searched for an appropriate procedure* 

A procedure was sought which would yield requirements specific 
to a position-situation relationship, stated in behavioral terms, 
and adequately coiaprehensive. The critical incident technique 
seemed to meet these criteria. Ccrbally, having used the technique 
in a dissertation, clain:ed that it went further by providing 

"recommendations which can be utilized immediately by practitioners 
2 

in the field". The technique is suitable for busy persons who 
have varied backgrounds • 

Originating in Amy Air Force testing, the critical incident 
technique has been adapted to the analysis of dimensions of 
professional positionr. It has been used to determine the re- 
quirements for research persorjiel, dentists, life insurance 
agency heads, general psychology instructors, and school adminis- 
trators • However, it has had very limited use in communication 
sVvidies and !.cn^^ U!)Dn :rorrj::auical* cr: in higher education prior 
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The critical incident procedure seemed suitable as a counterpart 
to open-ended questions which elicit attitudes that are loo often 
stereotypes. Critical incident procedure would define the conumani- 
cation related to department chairmen in specific, behavioral terns. 

A progression of steps has been refined by e^qperience since 
World War II. The design of the interview, especially the statement 
of the general aim, is to be carefully planned Those interviewed 
should have been in a position to observe the behavior they report. 
Elements are abstracted from the incidents by tne '-*isearcher or by 
those interviewed. The elements are categorized, . ut-.er with trial 
headings or by clusterir-g the elements as they are i lated. Con- 
sistency is cheeked by other persons who are instiv^v.&ed concerning 
the pattern of categories. The frequency of elements in categories 
is taken as indicative of those most often observed in conparable 
situations. 

Characterizing the technique as a "promising refinement of 

job analysis," Furst provided a statement of the basic assumption 

of the technique. 

The technique assumes that a job consists of two 
types of tasks, or behaviors: critical and non- 
critical . Critical behaviors are defined ac those 
that make the difference betveen success and 
failure in carrying out important parts of the job. 
Hence, they represent either very effective or 
very ineffective on-the-job behaviors, as judged 
by a qualified observer. Non^^ritical beha«/iors, 
on the other hand, derive from two sorts of tasks: 
(1 ) those having so little relation to success on 
the job that the way in which th ey are T>erformed 
tis of little jonseauence; ^,2) ^hose done well by 



mos t vorkers , £o that they are not q source of 
judpngntc on individuni erfectivenos's ^ As one 
would expect, tue technique foca^es on the 
critical behnviors and Ignores the noncriticol. 

• 

Obviously then, the technique doec not produce descriptions of the 

ideal or average. It is not normative* It is a oethod for analysis 

of that which has actually occurred and that which is considered 

critical at the time pf the interview. 

An over-view of the technique is given by the ija;i most responsible 

for its development, John C. Flanagan. 

The critical incident technique consists essentially 
in the collection of reports of behaviors which 
were critical in the sense that they made the 
difference between success and failure in the ob- 
served work situation. The individual observing 
and reporting the behavior is most typically a 
supervisor or an associate of the person involved 
in the incident. The incident is acceptable as a 
critical one only if in the obser-zer's ^tjdgnent it 
relates to an important aspect of the work and 
includes behavior which is outstandingly effective 
or is ineffective with reupect to the specific 
situation. The critical incident is principally 
characterized by its reference to actual behavior 
in a defined situation rather than consisting of 
assumed traits and other inferences made by the 
observer.^ 

In summary, the critical incident technique is a way of obtaining 
miniature cases which can then be inductively categorized so as to 
find the behavioral dimensions of the gener«il sim. 



Enrly Development of the Technique 

Eighteen volumes chronicle the testing of the Army Air Forces 
Aviation Psychology Proeram. The search for job analysis led to the 
deve.lopment of an analytical procedure for the critical requirements. 
Thin prccedur«-: mhh j-efiiv^d end termed the critical incident technique 



in the pos-i^-var yeerc. 
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As stated by John Tlnnn{:un, Director of the Aviation Psychology 
Program: 

Many studies were carried out by personnel of the 
Aviation Psychology Program in an effort to gain 
more information regarding combat requirements. 
Of special importance are those requirements which 
are critical in the sense that a significant 
number of missions have succeeded or failed because 
of the presence or absence of this elerent or 
quality. 5 

Flanagan believed that most of the defects in the programs were not 

in inefficient training but in having individuals learn the wrong 

things instead of the combat requirements of their assignments.^ 

In the summer of 19^1, a study of the reasons for failure in 

pilot training was begun. An analysis of the proceedings of elimination 

boards for pilots revealed a mixture of citation of events and such 

7 

generalizations as "poor judgment", or "Insufficient progress.*' The 
critical events were more useful. 

An early form of the critical incident technique is reported by 

8 

Crannell and Mollenkopf as having occurred in July, 19kk. At a 
redistribution center men had reported U90 cases illustrating qualities 
of leadership. Two hundred and thirty of these cases were processed by 
one man underlining traits and abilities that characterized the 
successful and unsu'^cessful leaders. He then classified the successful 
statements into 25 rttegories. Three other investigators, using the. 
25 original categories as a starting point, independently classified 
the statements. In a group meeting, the four i^solved disagreements. 
The same procedure was followed for the ststements regarding unsuccess- 
ful leaders. Under the one category, for example, "Sharing of 
information with r.ubordinaten," they placed the statement "E:cplninii 
everything that be knew to bis men so that they kriew what to expect. ^ 



BEST COPY hW\M£ 

In the second study, the researchers asked for actual Incidents 
in which leadership was dicplr:yed. Thus, they received fewer stereo- 
types end habitual actions. The behavior was limited to that of 
subordinates* In this study, some cases were placed under a number 
of categories. Here is one inciaent to illustrate. 

On our last raid over y 2rn Germnny we had been 
hit rather heavily icavl ^ only our No. k engine 
left, and tc make matters worse it woald not draw 
full power. IJo. 2 er.f^ine van not feathered but itc 
cylinder head te:np. vac over 300 degrees centigrade 
and there was bad detenit-on. At this time o'or 
engineer, a technical sergeant who had been helping 
the pilot (as our Tr.ain fuel and oil lines had been 
shot out) went back to the waist of the ship and 
directed, as xrell as helped, in the jettisoning of 
all possible material and assigning positions to the 
enlisted crew members both for their safety and the 
plane's. He demonstrated coolness, efficiency, and 
cornnon sense. 

The preceding incident was assigned tc thc^e categories: 

J.. Assumed special responsibility in combat emergency. 

2. Organized and directed the activities of others 
under hazardous circumstances. 

3. Remained cool and alert in eme.rgency. 

k. Demonstrated thorou^rh knowledge of the Job and 
equipLient. 

13. Organized the work by pitcbln;r in himself and 
not by soerely giving orders. -^^ 

Such assignment was felt to be an t-.rduous task for the five Judges used 

in the study. It should be noted bei-e that many of the categories of 

early studies in critical incident procedure were accomplished through 

a group of men. Also to be noted is the emergency nature of the 

j nescients collected. In each oricee, the Buccess or failure of action 

io more directly obner/nble than in realtri^i avay from war and machines 

eucb ar; co-rir.unicotion in educ??iic;.:. 



After the war, a group of men who had been involved in the Arny 

Air Force research formed a non-profit organization, Atnerican Institute 

for Research, with John Flanagan at its head. This organizetici gave 

the naii^ to the technique and further developed it. The group 

continued serving aviation through job analysis for airlines and did 

post-war efficiency studies in industry. ExaT35)les of their research 

were those of developing criteria for selection of comnercial airline 

pilots and criteria for selection of research personnel in physical 
12,15 

sciences. 

Under the direction of Flanagan, a number of dissertations was 

completed at the University of Pittsburgh. Wagner's dissertation was 

adapted to establish selection tests for the Pittsburgh School of 

Dentistry.*^^ Weislogel organized critical requirements for life 

insurance agency heads. Smit developed critical requirements for 

16 

instructors of general psychology courses. 

Burns reported that the first use of critical incident procedure 

17 

in education was by Domas. Within New England, Domas collected 
about a thousand incidents- from 198 teachers^ principals, supervisors 
and superintendents. This study was 'conducted under the joint 



sponsorship of the Educational Research Corporation and the Harvard 

aas 
19 



l8 

University Graduate School of Education. Domas did not succeed in 



completing the categorization of the incidents; 

Dimensions and functions of teachers were more successfully 

analyzed within a state. On a national basis, the ethical standards 

for the Atnerican Psychologicnl Association were summarized from 
21 

incidents. 
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Designing and preliminary testing 

lomediately, attention should be called to the fact that the 
framing of the interview is important. 

Flanagan noted the importance of the aim or purpose. 

The essence of the technique is that only simple types 
of judgments are required of the observer, reports from 
only qualified observers are included, and all observa- 
tions are evaluated by the observer in terms of^an agreed 
upon statement of the purpose of the activity. 

Purpose or general aim of the activity must be set in a way accept- 
able to the users of the analysis. The general aim should be stated in 
general terms to achieve maximiiin acceptance. The criteria of success 
or effectiveness must, in brief form, be agreed upon. 

Situations called for should be limited to those relevant to the 
attainment of the general aim. The extent of the effect should be a 
significant contribution, either positively or negatively, to the 
general aim of the activity. 

To encourage response of an exacting nature and to avoid bias, 
considerable effort should be spent upon focusing of the interview 
as to definitions, aim, and structured format. 

Selecting the observer group 

The contribution of incidents is determined by the value system 
and experiences of the contributors. Therefore, the contributors must 
be competent by virtue of holding appropriate positions. They must 

29 

have directly observed or experienced the incidents which they report. 

Certain competency of expression and interest may help. 

Robert L. Thorndike, as editor of one of the report volumes, complained 

about the fliers who were men of deeds and not articulate nor motivated 

30 

to provide insights. 
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« 

The critical incident technique seems especially popular in the 

analysis of areas of responsibility for administrators in education. 

Schvei and Stemloff studied the responsibilities of school administrators 
22 23 

in Wisconsin. ' Bums reported that four studies were completed as 

part of a coordinated sequence using the technique under a three-year 

grant to the College of Education at the University of Georgia. The 

technique was also used in studies of administration at Stanford and 
25,26 

Wyoming. 

From the above, it is possible to see the evolving of a technique for 
determining dimensions of success on behavioral terms from an area in which 
alternative criteria are rather obvious, as for example > flying; to areas 
with less discernible and more delayed outcomes, such as education. 

Typical Steps in Using the Critical 
Incident Technique 

Certain conditions are required. Probably these can be understood 

27 

most easily by consideration of them within the steps in the procedure: 

1. Designing and preliminary testing. 

2. Selecting the observer group. 

3. Collecting an adequate and representative sample of 
critical incidents. 

4.. Examining all incidents and rejecting those not meeting 
specified criteria. 

5. Isolating the critical elements contained in the critical 
incidents. 

6. Placing elements into categories of a developing taxonomy. 

7. Having independent analysts make consistency checks by 
categorizing random samples of incidents. 

8. Assessing proportions of elements in categories. 
The eight steps are elaborated in sequence* 



Flana(^ari went farther in analysis 
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In many instances participants knew very little 
about the critical requiz'enents of a particular 
activity. Tliey have very little information as 
to whether the difficulties which they have are 
typical of those which others have and are apt to 
dismiss individual differences in proficiency with 
comments regarding motivation and generalities. They 
have never found it necessary to make a systematic 
analysis of requirements for the activity aad their 
Judgments are usually in vague terms and likely to 
represent 'stereotypes* which have been suggested 
,to them in conversation. 51 

Flanagan's warning is especially appropriate in avoiding analysis by 

the respondents. However, with artic«aar and educated persons, the 

indication of elements has been profitable after presentation of the 

sequential facts of the events. y 



Collecting a'l^.equate and representative incidents 

Recall data may be used. The quality of the data is usually 

evidenced within incidents: 

If full and precise details are given, it can usually 
be assumed that this information is accurate. Vague 
reports suggest that the incident is not well 
remembered and that some of the data may be incorrect. 

So incidents, to be acceptable, should be precise, complete, and 

consistent. 

Three principal ways of obtaining the recall data are mailed 
questionnaire, groi^) Interviews, and individual interviews. A mailed, 
questionnaire cannot directly deal witl need for further explanation 
or a lack of motivation to respond. This problem is especially 
troublesome in the critical Incident technique since the format is 
alien to most rei^poudents and they may fear such material might get 
iutc the wrong hands. Also, cons I iernbl^ thought End writing ure 
required. 
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Tinie &r.d travel expense usually limit an individual interview 
approach to 100 respondents as in the Kessel and Kosy studies. ^'-^ 
Hovever, this writer felt that the complexity of communication is such 
that a larger numbsr of respondents were needed. 

The number of incidents gained from each respondent varies from 
about two to six in the various studies. Enough incidents must be 
obtained to provide an adequate number of critical behaviors. 
"Critical behaviors" or "critical elements" are those aspects of the 
incidents which are considered to be crucial to the quality of the 
Incident. Enough incidents are required to assure achievement of most 
of the categories. Tacey and Jensen reported that 1*00 incidents gave 
them most of their categories . The cougplexlty of the task 

affects the number of incidents required. 

Tape recording of the interviews may be done. In a personal 

interview at the American Institutes for Research, Dr. Dyslnger warned 

37 

of the need for editing such transcripts. Kohl reported that the 
502 incidents of 70 interviews resulted in 972 double spaced pages. ^ 
He was forced to do much auditing of tapes and correcting of typescript 
for the typist not acquainted with th? terminology. His typists 
required I76 hours, almost six times the amount of time required for 
the recording of incidents. 

« 

Couch recorded two interviews and compared typescript with notes, 

39 

finding no need for recording. 

As indicated by Flanagan, there are certain conditions to be 

ho 

provided for the interview. 

1. Tlie purpose end role of the interviewer shou3.d be made clear. 

2. Why the interviewee was selected should be aiuswered without 
delay. 
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5. Anonyroity of the data is to be assured. 

U. Objective, unifonnly presented questions should be pretested 
to avoid bias. 

5. Conversation should be neutral and permissive, accepting the 
observer as the expert. 

Rejection of incidents not meeting criteria 

The incidents should meet certain crit'jria. Frequent criteria 
kl 

are these. The incidents should be: 

1. Relevant to the general aim. 

2. Specific as to action. Behavior centered, not generalized 
traits . 

5. Reported by person in position to observe the behavior. 
k. Actually observed or participated in by the reporter. 

5. Recent enough to not be brought to memory as a bizanre case. 

6. Intern'ally consistent. , 

7. Clear, not vague or ambiguous. 
6. Complete . 

There should be a certain directness and crispness to the report. 

Isolating the critical elements 

Given enough details and the results, the isolation of elements 
is fairly straight forward. On occasion, there may be some question as 
to when to separate ab elements or retain as one elemental act. 

To Illustrate, here is an ineffective incident provided by 

Sternloff . The result, clear enough, gives validity to the element. 

This was chosen because it is in the area of communication. The 

critical element was underlined by Sternloff. 

It was learned that an administrator had contacted 
a young man and offered him a teaching position. 
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The teichor who held the position for two yearc 
was not notified of his pendinr; dismisscl by the 
adniniatrator but leai-ncd of it from friends in a 
neighboring school. Tlie administrator lost the 
confidence of his oun staff and nic^de thai insecure 
and uncertain. Fellow administrators in the area 
ielt that he had le*, the profession down.^^ 

The underlined element can be lifted off and place* upon a card for 

sorting . 

Corbally provided the following incident and a somewhat different 

procedure in a coding which used statement of elea&nts by the analyst. 

In this case, a school superintendent was the observer 
and he was observing his board of education as they 
performed their varying tasks. He was observing them 
with particular emphasis on the manner in which their 
behavior influenced school-community relations. He 
observed, for example, one incident in i&ich an 
irate citizen appeared before the board demanding 
to know why his social club was denied permission 
to use the school gummas ium for a bazaar. The board 
members were courteous and tactful as tley carefully 
explained their written and long-established policy 
regarding community use of school buildings. The 
citizen was completely satisfied, thanked the board 
for its time, and complimented the board metabers on 
the clarity of their policy. '^^ 

These elements were isolated by Corbally: 

1. The board adopts written policy to give consistency 
to its actions. 

2. The board adheres to its written policy. 

5, Board members are courteous, and tactful with 
visitors at board mee tings. 

This writer wo'ild demur slightly in noting that there seems to 

be an assumption as to reasoning by the board in the first element. 

The narrative does not state that they had said tLat. 
« 

The tone of the incident may be retained better by using the 
words of the one who experienced that incident. However, the 
respondent is not to jTovide evaluations or interpi^tations . As 
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Wagner stated it: "No interpretations of the individual's psychological 
characteristics, such as abilities, aptitudes, motivations, and 
attitudes, which might be responsible for the behavior is desired." 
However, in sonie interview studies, the respondent is asked which 
part of the behaviors already leported he considers to be critical 
elements . 

Placing elements into categories 
of a developing taxonomy 

Usually, the initial sorting is facilitated by tentative use of 
a frame of reference from earlier work in the field* The frame of 
reference is tested and often either rejected or changed because of 
the nature of the data. 

Instead of deductive classification from a tentative frame of 
reference, a classification system may be generated inductively. 
Thus, inductively, the first elements create almost individual 
categories. Following elements fall into the categories provided by 
earlier elements or create need for new categories. The categories 
grow until examination reveals that the categories can be logically 
assigned to sub-areas. Later examination reveals possible grouping 
into areas. Thus, grouping proceeds from categories to sub-areas and 
to areas. 

As written by Flanagan, "The aim is that of increasing usefulness 
of the data while sacrificing as little as possib].^ of the comprehen- 
civeness, specificity, and validity." 

The descriptive titles grow as -the categories are developed. The 
categories are in constart evolution as in the Flanagan study of 
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Critical Requirements for Besearoh Workers. Barnhard, Weislogel, end 

kB Uq 50 

Herzberg also used such an inductive approach. ' ' 

Each shift of a sub-point requires a restudy of the vhcle. 

Examination enables combination of sparsely supported beadines and the 

new heading is carefully written at a higher level of generalization, 

seeking to maintain a practical level. As indicated in the Preston 

study, there seems to be a great gathering together at the end in a final 

51 

revision toward the final statement of requirements. 

Having analysts make a consistency check . 

This occurs at different tioes in the studies: when the major 

areas have been used with a few hundred elements, later with an outline 

which gives titles of areas and sub -areas, or still later with full 

statement of titles. Early use encourages further use of the headings. 

Later use probably gives a better basis for final revision. 

The range of disparity between the check coder and the Investigator 

5?^ 

In ten dissertations was from h per cent to 51 per cent. Sub -areas 
were more difficult than the main areas. Also^ Heckman showed a 
greater disparity for Ineffective elements.-'^ 

After the consistency check, there is usually some discussion and 
revision to clear up misunderstandings or headings which are not clear. 

Assessing proportions of elements in categor3es 

The frequencies of behaviors grouped in the categories may be 
t^aken as an index of those behaviors most frequently observed as 
responsible for success or failure. Corbally warned of a mieunder- 
standins here. "Some elements may occur more often in the course of a 
Job than will others, but this frequency of occurrence in no way 
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denotes a degree of criticalness," Here, Corbally was thinking of the 
seriousness of the consequences. 

A statement as to weighting is given in industrial terms by Good 
and Scate: 

The number of instances that fall in one or another 
of the categories is not necessarily an indication 
of the importance of that category for the job, but 
it's an index of the importance of that category in 
terms of number of acts likely to be observed which 
make a supervisor feel an employee is superior or 
inferior. 5i> 

Probably, the criticalness of any one behavior over another is not to 
be asserted for any one situation. 

The determination of the less frequent, but more serious Incident 
is dependent upon the application of the appropriate background of an 
analyst. Such a determination should be subject to review of the 
basic data. 

Critical Incidents in Communication 

In a dissertation upon the role of academic department heads, 
Aldmon studies the incidents reported from department heads and 
members of departments at the University of Tennessee, the University 
of the South, and Western Carolina College.^ A summary of the 
effective behaviors evidenced by chairmen and related to coramunication 
follows: (1) Displays emotional stability, (2) Shows consideration of 
others, (:) Provides for cooperative planning, (k) Seeks solutions to 
probleir.s through scientific procedures of problem solvirig, and 
(5) Communicates freely with others. These five behaviors out of a 
total, of eiftht in the list are communication related. 
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Three dissertations are completely within the communication area. 
Wilson collected incidents from the superintendents and principals 
of the Ohio city school districts, excluding the largest six cities.^' 
The size of the district was not important, hut age of the reporting 
person was. Those over the age of forty gave significantly more 
elements in the operational (more mechanical) as compared with the 
organisational dimension (establish and maintain structure). Seventy- 
two per cent of the total incidents were in the operational dimension. 

58 

Gropper wrote one of the more useful dissertations. Twenty-five 
business leaders were asked for the primary purpose of business con- 
ferences. A summary statement was made and checked against published 
ideas. Behaviors especially effective and ineffective in conference 
behavior were collected from persons in business, government, and 
military organizations. Univ^^rsity night classes furnished much of 
the data concerning acts, results, and frequencies. Listt? of functions 
were • compiled for participants and leaders. 

Tacey used interview, questionnaire, and diary to collect his 
incidents of effective and ineffective oral communication of foremen in 
steel plants of -^he Pittsburgh area.?^ " iathough it was revealing 
concerning communication of foremen, many of the incidents ai'e not 
transferable into higher education. 

The preceding four dissertations demonstrate the suitability of 
the critical incident technique for administrators in different 
environments of communication. Their results reveal that certain 
environmental conditions ore to be resyert*!'!, A college, a school, or 
a factory will not produce results whlcl-' can be directly transpopsd to 
one of the other two environments. 
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Evaluation of the Critical Incident Procedure 



An evaluation was given by Sternloff vhich was extracted from its 

60 61 

illustrations and applications by Goldin. ' Here, the list is 
further shortened and highlighted by underscoring. Goldin 's li&t 
included the first three disadvantages. Other writers, as cited with 
text, have extended the disadvantages beyond the three taken from 
Goldin. 



Advantages of the Critical Incident Technique 

1, Genuinely important situations for that position are sought 
out, those responsible for success or failure in the eyes 
of the reporter. 

■i 

2* Specific requirements for the position are produced through 
statement in terms of the situations which characterize 
the position. 

5, Requirements are precise statements rather than gencrelizatione . 

U. Report is comprehensive through a large number of observers' 
in varied circumstances freely reporting events. 

5. • It is relevant through freedom of choice and use of actual 

experience. Distortion by limited pei-soaal viewpoint, con» 
versational stereotypes, or predetermined lists is avoided. 

6. Relative weighting is provided through indication of those 
factors probably most frequently observed as responsible 
for success or failure. 

7. Not requiring personal participation or long periods of 
observation, it is economical . Persons well acquainted with 
the activity are utilizecl as reporters of behavior they have 
observed. 

8« A nonymity is assured by a melding of the elements into 
etatements of requirements. 
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Dlsadvnntnires of the Critlcol Incident Technique 

1. Wasted effoit may be experienced throuch reporters vho through 
habit make evaluative rather than descriptive remarks. 

2. Bespondents may have difficulty in establishing criteria for 
selecting incidents. The degree of criticalness to Jise is 
difficult for them to assess. 

3. The technique came from the situations of men with machines. 
More complex situations may yield false conclusions. 

U. Corbally assessed weaicness in terms of delayed results and 
unrecognizable results . 

The method assumes that observers can report inci- 
dents in which outcomes in terms of the aims of 
the undertaking are clearly recognizable. This 
leads to two distinct problens. Outcomes in 
education are often either deferred, unrecognizable, 
or both. Aims are often unformed, controversial, 
misunderstood, capable of many interpretations 
or any combination of these and other factors.-^" 

5. The objective, external events are stressed, not the internal^ 
motivational aspects. Burns noted that the technique has 
difficulty in dealing with attitudinal affect. 

6. Burns also noted that the procedure tends to exclude the 
necessary, but insufficiem; conditions, "0 Probably, the 
cumulative effects of small habits ai-e not dealt witli 
adequately. One author reported that they appear as the 
recent, but perhaps to the coder, rather insignificant 
incidents. 

7. The technique contains many subjective elements which are to 
be viewed as limitations of the conclusions. There is an 
indication of this in the high percentage of disagreement 

in the consistency check. 

A major advantage of the procedure is that it enables definition 
of work raquirements wjth freedom from preconceived lists through the 
use of actual events. The opportunity to discover dimensions of 
organizational communication justified the risk of difficulties with 
habits, attitudes, and the complexity of conrnunication processes. In 
this freedom to discover from unusual events, the critical incjdent 
procedure complements rej-iorts of usual communication practices. 
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Brief Description of Critical Incident Procedures in 
a Study of Communication Related to Chaixmen"^ 

Procedure 

For the critical incident procedure, definition and general aiT.s 
of communication related to chairmen were determined two questionnaire 
forms returned by thirty-two chainaen of departments ia private colleges 
and universities in the northeastern states. Communication was defined 
as "written and spoken exchange of ideas and feelings, either in 
person-to-person or person-to-group situations." The three general 
aims of communicatior. were climate, decision, and action. 

Chairmen were to report critical events related to the position 
of chairmanship which they had directly observed or experienced during 
the two years prior to the interview. On the coapuses of 22 state- 
supported institutions, 269 chairmen described 585 iiicidents during 
personal interviews. 

The incidents were distributed into categories of areas of 
responsibility and d5rections within the network. The areas of 
responsibility weru initially derived from previous studies of chair- 
men and further expanded. 

In communication network analysis, -incidents of communication 
'were analyzed according to organisational dimensions. Incidents were 
alsc analyzed as to specific directions of communication. 

The chairmen had identified 706 elements in the incidents. 
Inductively, with no frame of reference, the elements were ordered 
into a taxonomy of critical comnnu:iication processes. Since most of 
the divisions had been formed before the lar-t huiidrcd elements were 
c3ej-:r,ified, it was believed that the classifi-^ijtion of probable 



BEST COPY mum 

categories was fairly exhaustive. 

A consistency check was done by a university planning administrator, 
an adniinistrative assistant of a university physics department, and 
a hospital adciinistrator. The agreement of the coders was high enough 
to indicate satisfactory coding for practical use. 

There had been difficulty in the categorization of communication 
processes. Six weeks had been required for this work. 

Difficulties were produced by closely related sub-categories. 
There were problems of choice between the action and the intent. 
These problems were especially difficult with the ineffective ii cidents 
Which require that classifier translate ineffective incidents into a 
positive statement of requirement. When the decision was balanced 
between means or objective, the objective was used. However, the 
objective was declared by the chairman, not induced by the classifier. 

Each chairman had a somewhat different frame of reference in the 
use of the term "communication." These frames of reference were more 
dominant in this study because the chairmen were asked to single out 
the elements which were used. 

Work was slowed by not using an initial category pattern. Very 
few critical incident studies do not start the classification with a 
frame of reference borrowed from prior work in the field, such as 
categories of administrative responsibilities. 

The retention on the card of the complete statement of the 
incident required constant re-reading of more material than only an 
element card*would have required. However, it was felt that a complex 
process required consideration of the whole incident at the time of 
classification. 
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"Comrcmiication" has processes which are difficult to classify. 
A situation, an action, inuuediate result, and delayed result may bo 
conplicated by attitudinal a::pect3 of situation and results. The 
chairman may be able to report the effect of communication upon his 
ovn attitudes, but attitudinal consequences in others should be 
supported by observable behavior. The observable aspects of situation 
or condition may be elements when presented in enough detail and not 
adequate when left in a general statement. Delayed effects or 
generality of impression are frequent in communication. 
Some Results 

Within the areas of responsibility of chairmen, "Faculty business" 
and "Curriculum" were areas in which effective incidents were 
emphasized. The "Acquisition and maintenance of property" was 
weighted with ineffective incidents. "Student relations" did not 
receive much attention in the incidents. 

Network analysis revealed that ineffective incidents were 
dominant ly failures to communicate, primarily from chairman to members 
of the department. Within effective incidents, the dominant direction 
was also from chairman to individuals of the department. 

The taxonomy of critical incident processes showed more than a 
thii'd of the elements to be under the major area cf "Maintaining the 
organization". "Initiating and maintaining an authority structiu'e" 
was heavily weighted with ineffective elements. In contrast, "'i'aking 
charge as ona in authority" was heavily weighted with effective 
incidents. The critical processes of commuid cation were primarily 
in two major dimensions of leadership — organizational and social-enotlonal. 
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Size of departments was so small, over-coinmunication was so 
little, and strictures were so simple that to transfer frames of 
reference from the realms of business or the military seemed to bo an 
error. There was a complexity of directions of communication which 
had not been found in a preliMnary analysis of the industrial 
foreman-worker situation. In the sharing of responsibilities, 
complex directions of communication and effects of personalities 
were created. Different frames may be needed for the collegial 
situations. 

Conclusion 

Critical incident technique may have; utility for an initial 
audit. However, the technique must be considered in relation to its 
origin—evaluation of "ineffective" landings by pilot trainees. In 
contrast, communication does not function as an event which would 
have general agreement as to aims, start, finish, and success or 
failure. Communication is a process wnich is complicated by prior 
events, attitudes, and varied aims. 

The technique does reveal problem areas of communication as to 
subject and direction. It is an antidote to tne open-ended question 
which often elicits the reciting of s-hibboleths. Results provide a 
pattern of critical communication behaviors. 
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